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1 Introduction 


What is computation? This question usually assumes that the Turing machine! 
[23] is the standard model [18, 19, 21]. We reexamine this question with a new 
model, called the ex-machine [12]. This model adds two special instructions to 
the Turing machine instructions. The name ex-machine comes from the Latin 
term extra machinam because the ex-machine computation is a non-autonomous 
dynamical system [10] that may no longer be considered a machine.* The meta 
instruction adds new states and new instructions or can replace instructions. The 
random instruction can be physically realized with a quantum random number 
generator [14, 15]. When an ex-machine uses meta and random instructions, its 
program complexity (machine size [3]) can increase, unlike a lever, pulley, or Turing 
machine. Two identical ex-machines can evolve to different ex-machines even when 
both start executing with the same tape input and initial state. 

We combine self-modification and randomness and construct an ex-machine 
Z(x) whose program complexity |Q||A| increases as it executes.> Z(x)’s non- 
autonomous behavior circumvents the contradiction in an information-theoretic 
proof [4, 5] of Turing’s halting problem. The proof’s contradiction depends upon an 


'The conception of the Turing machine was motivated by Hilbert’s goal to find a general method 
for constructing proofs of mathematical theorems [15]. 


Each Turing machine is a discrete autonomous dynamical system in C. See the Appendix. 
3Q and A represent the ex-machine states and alphabet, respectively. 
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information-theoretic property: each Turing machine is representable with a finite 
number of bits that stays constant during the entire execution. Some ex-machines 
violate this property. Z(x)’s circumvention occurs because its meta instructions 
increase the number of states and instructions in Z(x), based on random information 
obtained from its random instructions. Hence, the minimal number of bits that 
represent an ex-machine’s evolved program can increase without bound as execution 
proceeds. 


1.1 Related WorkK—Computation 


In [24], the notion of providing an oracle was introduced. Turing stated that an 
oracle cannot be a machine but did not provide a physical basis for its existence. 
For a summary of various physical realizations that use quantum events to generate 
random binary outcomes, see [14]. In [7], the following question was asked: Is 
there anything that can be done by a machine with a random element but not 
by a deterministic machine? They showed for a Turing computable probability 
Pp (e.g., p = 5) that any set of output symbols that can be enumerated with 
positive probability by their probabilistic machine can also be enumerated by 
a Turing machine. Overall, they were unable to produce Turing incomputable 
computation when p is Turing computable. In [13], a framework is developed for 
self-modifying programs, but it does not include randomness and does not address 
computability. In [11], a parallel machine self-modifies with meta commands and 
takes quantum random measurements to execute a Turing incomputable black box. 
Prior hypercomputation models [8, 16, 17] are not physically realizable. 


2 The Ex-machine 


Z, N, and Nt are the integers, non-negative integers, and positive integers, 
respectively. The finite set Q = {0, 1, 2,...,— 1} C N represents the ex-machine 
states. As a subset of N, Q helps specify how new states are added to Q when a meta 
instruction executes. Let V = {aj,...,a,}. The set A = {0,1, #} U V consists of 
alphabet (tape) symbols, where # is the blank symbol and {0, 1, #} 1 V = @. In 
some ex-machines, A = {0,1,#,Y,N,a}, where V = {Y,N,a}. Sometimes, 
A = {0,1,#}. Alphabet symbols are scanned from and written on the tape. The 
tape is a function T : Z — A. We say T is finite [21], whenever a finite number of 
tape squares T (k) contain non-blank symbols. 
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2.1 Standard Instructions 


Definition 1 (Execution of Standard Instructions) Standard instructions S 
satisfy S C Qx Ax Qx A x {-1,0,1} and a uniqueness condition: If 
(91,01,71,41,y1)€ Sand (q2,02,72,4a2,y2)€ S and (q1,%1,71,41, 91) F 
(G2, &2, 72, 42, y2), then (q1, a1) € (g2, a2). Instruction J = (q,a,r,a, y) follows 
[19]. When the ex-machine is in state g and the tape head is scanning a = T(k) at 
tape square k, I executes as follows. The ex-machine state moves from state q to 
state r. Alphabet symbol a is replaced with a so that T(k) = a. If y = —1 or 1, the 
tape head moves one square to the left or right, respectively. If y = 0, the tape head 
does not move. 


A Turing machine [23] has a finite set of machine states, a finite alphabet, a finite 
tape, and a finite set of standard instructions that execute according to Definition 1. 
An ex-machine that uses only standard instructions is called a standard machine 
and is computationally equivalent to a Turing machine. The Turing machine is the 
standard mathematical model of computation, realized by digital computers [1]. 


2.2. Random Instructions 


This subsection defines two random axioms and the random instructions. Repeated 
independent trials are called quantum random Bernoulli trials [9] if all trials have a 
quantum random measurement [14] with only two outcomes and the probability of 
each outcome stays constant. Unbiased means that the probability of both outcomes 
is the same. 


Random Axiom 1 (Unbiased Trials) Quantum random outcome x; measures 0 or 
1. Probability P(x; = 1) = P(x; = 0) = 5. 


Random Axiom 2 (Stochastic Independence) Prior measurements x1, ..., Xj—1 
have no effect on the next measurement x;. For each b; € {0, 1}, the conditional 
probabilities satisfy P(x; = I|x1 = b1,...,xj-1 = Di-1) = 5 and P(x; = O|x; = 
bj, ...,%j-1 = Bj-1) = 5 


Definition 2 (Execution of Random Instructions) Random instructions 
are a subset of Q x A x Q x {-1,0,1}. K satisfies uniqueness condition: 
If (q1,a1,71, 91) € KR and (q2,a2,7,y2) € R and (q,a1,r1,y1) F# 
(q2, &2, 72, y2), then (g1,a1) 4 (q2, a2). When scanning symbol a and in state 
q, instruction (qg, a, r, y) executes as follows: 


(1) Measure bit b € {0, 1} from a quantum random source that satisfies both 
axioms. 

(2) On the tape, an alphabet symbol a is replaced with a random bit b. Note {0, 
1} CA. 

(3) The ex-machine state g changes to state r. 
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(4) The tape head moves left if y = —1, moves right if y = 1, and does not move 
ify =0. 
Example | lists a random walk ex-machine; it shows how the random instructions 


execute and how the ex-machine can exhibit non-autonomous dynamical behavior. 


Example I (Random Walk Ex-machine) Alphabet A = {0, 1, #, E}. Q = 
{0,1,2,3,4,5,6,h} with halting state h = 7. There are 3 random instructions 
(0,#,0,0), (1,#,1,0), and (4,#,4,0). 


(0,#,0,0) (0,0,1,0,-1) (0,1,4,1,1) ; Comments follow a semicolon. 
(1,#,1,0) (1,0,1,0,-1) C1 AGO ey ) ; Resume random walk to the left 
of tape square 0 
(2,0,3,#,1) (2,#,h,E,0) (2,1,h,E,0) 
(3,#,0,#,-1) ; Go back to state 0. Number of random 0’s = Number of 
random 1's. 
(335-0: /2,-0i-L) ; Go back to state 1. Number of random 0's > Number of 
random 1's. 
(3,1,h,E,0) 
(4,#,4,0) (4.4.42) (4,0,5,#,-1) ; Resume random walk to the right 
of tape square 0 
(5,1,6,#,-1) (5,#,h,E, 0) (5,0,h,E, 0) 
(6,#,0,#,1) ; Go back to state 0. Number of random 0’s = Number of 
random 1's. 
(6,1,4,1,1) ; Go back to state 4. Number of random 1's > Number of 
random 0’s. 
(6,0,h,E,0) 


A valid initial tape contains only blank symbols. A valid initial state is 0. At 
step 1, random instruction (0,#,0,0) measures 0, so it executes (0,#,0,0,0). 
At step 3, instruction (1,#,1,0) measures 1, so it executes (1,#,1,1,0). (Per 
Definition 2, 0, means 0 was randomly measured, and 1, means | was measured.) 
In all executions shown, the tape head is reading the symbol to the right of the space. 
The sequence of tape symbols shows the tape contents after the instruction in the 
same row has executed. 

First Execution of Random Walk Ex-machine. Steps 1-7. 


STATE TAPE HEAD INSTRUCTION 
0) HHH O#HH 0) (0,#,0,0,,0) 
1 HH HOHHH -1 (0,0,1,0,-1) 
1 HH LO#HH al. (1,#,1,1,,0) 
2 HHH O#HH 0) (1,1,2,#,1) 
3 HHEH HHH 1 (2,0,3,#,1) 
) HE HHHH ) (3,#,0,#,-1) 
) HHH O#HH ) (0,#,0,0;,0) 


For the second execution, at step 1, a random measurement returns a 1, so 
(0,#,0,0) executes as (0,#,0,1,0). Instruction (4,#,4,0) measures 0, so 
(4,#,4,0,0) executes. 

Second Execution of Random Walk Ex-machine. Steps 1-7. 


STATE TAPE HEAD INSTRUCTION 
) HHH 1LHHH 0) (0,#,0,1,,0) 
4 HHHL HHH 1 (0,1,4,1,1) 
4 H#H1 O## 1 (4,#,4,0r,0) 
5 HHH HHH 0) (4,0,5,#,-1) 
6 HH HEHEHE =1 (5,1,6,#,-1) 
0) HHH HEHE ) (6,#,0,#,1) 
) HHH LHEH 0) (0,#,0,1,,0) 
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The first and second executions show that the execution behavior of the same ex- 
machine with identical initial conditions may be distinct at two different instances. 
Hence, the ex-machine is a discrete, non-autonomous dynamical system [10]. 


2.3 Meta Instructions 


This subsection defines the meta instruction and the notion of evolving an ex- 
machine. The execution of a meta instruction can add new states and new 
instructions or replace instructions. Formally, the meta instructions Jt satisfy 
mc {(i¢.a.r,a,y,J):qeéeOQ andre QU{|Q} and aaaeA 
and instruction J € GU}. Define J = GURU IM, as the set of 
standard, random, and meta instructions. To help describe how a meta instruction 
modifies J, the unique state, scanning symbol condition is defined. For any two 
distinct instructions in 3, at least one of the first two coordinates must differ. More 
precisely, all six of the following uniqueness conditions must hold. 


1. If (q1,01,71, Bi, y1) and (q2, @2,7r2, B2, y2) both are in G, then (qi,a1) 4 
(q2, @2). 

2. If (q1, 41,71, Bi, 1) € G and (q2, a2, r2, y2) € KR, then (qi, a1) F (q2, a2). 

3. If (gi, 01,71, yi) and (q2, &2, 12, y2) both are in 7, then (qi, a1) # (q2, a2). 

4. If (g1,01,71,y1) € KH and (q2, a2,72, 42, y2, J2) € M, then (gj,a1) F 
(q2, 2). 

5. If (qi,a,7i1, Bi, v1) € G and (q2, 02,72, a2, y2, Jz) € M, then (q1,a1) F 
(q2, @2). 

6. If (g1, 01,71, 41, y1, Jt) € MN and (g2, a2, r2, a2, y2, Jz) € Mt, then (gi, a1) # 
(q2, 2). 


Given a valid machine specification, conditions 1-6 assure that there is no ambiguity 
on what instruction to execute. The execution of a meta instruction preserves 
conditions 1-6. 


Definition 3 (Execution of Meta Instructions) Meta instruction (g,a,r,a, y, J) 
executes as follows: 


(1) The first five coordinates (g,a,r,a, y) are executed as a standard instruction 
according to Definition 1 with one caveat. State q may be expressed as |Q|-¢ 
and state r may be expressed as |Q| or |Q|-d, where 0 < c, d < |Q|. 
When (q,a,r,a, y) is executed, if g is expressed as |Q|-c , the value of q 
is instantiated to the current value of |Q| — c. Similarly, if r is expressed as 
|Q| or |9Q|-d, the value of state r is instantiated to the current value of |Q| or 
|Q| — d, respectively. 

(2) Instruction J modifies 3, where J has the form J = (g,a,r,a,y) or J = 
(q,a,r, y). If J U {J} satisfies the unique state, scanning symbol condition, 
then 3 is updated to JU {J}. Otherwise, there is an instruction J in 3 whose first 
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two coordinates g and a equal instruction J’s first two coordinates. In this case, 
instruction J replaces instruction J in J, and 3 is updated to 3 U {J} — {J}. 


Remark I (Ex-machine Instructions are Sequences of Sets) This remark clarifies 
the definitions of machine states, standard, random, and meta instructions. The 
machine states are formally a sequence of sets. When the notation is formally 
precise, the machine states are expressed as Q(m), where m indicates that the 
mth computational step has executed. The standard, random, and all ex-machine 
instructions are also sequences of sets, represented as G(m), (mm), and 3(m), 
respectively. Usually, index m is not shown in expressions Q, G, KR, Mt, or J. 


Example 2 shows how to add an instruction to 3 and how to instantiate new states 


inQ. 


Example 2 (Adding New States and Instructions) Consider a meta instruction 
(q, a, |Q|-1, a1, v1, J), where J = (|Q|-1, az, |Q|, a2, y2). After instruction 
(q, a, |Q|-1, a1, y1) executes, this meta instruction adds a new state |Q| to the 
states Q and adds instruction J, instantiated with the current value of |Q|. For 
clarity, states are red and alphabet symbols are blue. Set N = { 0, 1, 2, 3, 4, 5, 


6, 7}. Set A = { #, 0, 1}. An initial configuration is shown below. 
State Tape 


5 ##11 O1## 

Meta instruction (5, 0, |Q| — 1, 1, 0, J) executes with values g = 5, a; = 0, 
a, =1,y) = 0,a2 = 1, a2 = #, and y2 = —1. Note J = (JQ|-1, 1, |Q|, #, —1). 
Since |Q| = 8, instruction (5, 0, 7, 1, 0) is executed. Also, standard instruction J = 
(7, 1, 8, #, —1) is added as a new instruction. The instantiation of |Q| = 8 in J adds 
state 8; the states are updated to N = {0, 1, 2, 3, 4, 5, 6, 7, 8}. After (5, 0, |Q| — 1, 
1, 0, J) executes, the new ex-machine configuration is shown below. 

State Tape 
| #H#11 11## 

Now, the ex-machine is scanning a 1 and lying in state 7, so the standard 

instruction J = (7, 1, 8, #, —1) executes. (Note that J was just added to the 


instructions.) After J executes, the new configuration is shown below. 
State Tape 


8 HHL 1LHLHH 


Remark 2 (Self-reflection of |SQ| ) Consider an ex-machine X with a meta instruc- 
tion J containing symbol |Q]. The instantiation of || invokes self-reflection about 
X’s current number of states, at the moment when X executes J. This type of self- 
reflection can be physically realized. 


Definition 4 (Simple Meta Instructions) (g,a,|Q|-d,b,y), (q,a,|QI, 
b,y) ’ (Ol=e)a, r,y) , ((Q)|-¢,a, |Q|-d,b,y) > Or (l=e,e; |Q| ,b,y) 
are valid expressions for simple meta instructions, where 0 < c,d < |Q|. Symbols 
|Q|-c, |Q|-d, and |Q| instantiate to a state based on the value of |Q| when the 
simple meta instruction executes. 


Herein, ex-machines self-reflect only with symbols |Q|-1 and |Q]. 
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Example 3 (Execution of Simple Meta Instructions.) A = {0,1,#} and Q = {0}. 
Instructions (|Q|-1,#,|Q|-1,1,0) ({Q|-1,1,|Q|,0,1) 


STATE TAPE HEAD INSTRUCTION NEW INSTRUCTION 
) # lt ) (0,#,0,1,0) (0,#,0,1,0) 
1 #0 ## 1 (0,1,1,0,1) (0,1,1,0,1) 
1 #0 1# 1 (1,#,1,1,0) (1,#,1,1,0) 
2 #00 # 2 (1,1,2,0,1) (1,1,2,0,1) 


With an initial blank tape and starting state of 0, four computational steps are 
shown above. At step 1, X scans # and lies in state 0. Since |Q| = 1, a simple meta 
instruction (|Q|-1,#,|Q|-1,1, 0) instantiates to (0,#,0,1,0) and executes. 
At step 2, X scans 1 and lies in state 0. Since |Q| = 1, (|Q|-1,1,|Q],0,1) 
instantiates to (0,1,1,0,1), updates Q = {0, 1}, and executes (0,1,1,0,1). 


Definition 5 (Finite Initial Conditions) Ex-machine X has finite initial conditions 
if the 4 conditions hold before X’s instructions are executed: (1) The number of 
states |Q| is finite. (2) The number of alphabet symbols |A| is finite. (3) The 
number of instructions |5| is finite. (4) The tape is finite. 


An ex-machine’s initial conditions are analogous to a differential equation’s 
boundary value conditions. Remark 3 assures that the ex-machine computation is 
physically plausible. 


Remark 3 (Finite Initial Conditions ) Tf the machine starts its execution with finite 
initial conditions, then after the machine has executed / instructions for any positive 
integer /, the current number of states Q(/) is finite and the current set of instructions 
J(J) is finite. Also, tape T is still finite, and the number of quantum random 
measurements obtained is finite. 


Proof The execution of one meta instruction adds at most one new instruction and 
one new state to Q. Using induction, Remark 3 follows from Definitions 1, 2, 3, 
and 5. 


An ex-machine can evolve from a prior computation. Evolution is useful: 
random and meta instructions can increase an ex-machine’s complexity via self- 
modification. 


Definition 6 (Evolving an Ex-machine) Let 7p, T;, T,...7;—, each be a finite 
tape. Consider an ex-machine Xq with finite initial conditions. Xo starts executing 
with tape 7p and evolves to ex-machine X; with tape S, after the execution halts. 
Subsequently, X; starts executing with tape 7; and evolves to X2 with tape Sp. 
This means that when ex-machine X, starts executing on tape 7), its instructions 
are preserved after the halt with tape S;. The ex-machine evolution continues until 
X;_1 starts executing with tape 7;_; and evolves to ex-machine X; with tape S; after 
the execution halts. One says that the ex-machine Xg evolves to X; after i halts. 


When Xo evolves to X1, then X; evolves to X2, and so on up to X,,, then X; is an 
ancestor of X; if0 <i < j <n. Similarly, X; is a descendant of X; wheni < j. 
The sequence of ex-machines Xp > X; > --- > X,... is an evolutionary path. 
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3 Computing Ex-machine Languages 


A class of ex-machines are evolutions of a fundamental ex-machine 3(x), whose 15 

instructions are listed in Definition 9. These ex-machines compute languages L that 

are subsets of {a}* = {a” : n € N}. a” stands for n a’s. The empty string is a° and 

a? = aaa. Set language space £ = L) {L}. Function f : N > {0, 1} defines 
Lc{a}* 

language L -. 

Definition 7 (Language L;) f : N — {0,1} induces language Ly = {a” : 

f(n) = 1}. String a” isin Ly iff f(n) = 1. 


Trivially, L ¢ is a language in £. Moreover, these functions f generate all of £. 


Remark 4 (Language Space) £ = \|J {Ly}. 
fe{0,1)8 

Definition 8 (X Computes Language L in £) Set alphabet A = {#, 0,1, N, Y, a}. 
Let X be an ex-machine. The language L in £ that X computes is defined as follows. 
A valid initial tape has the form # #a”#. The valid initial tape # ## represents 
the empty string. After X starts executing with initial tape # #a”#, string a” is in 
X’s language if X halts with tape #a”# Y#. String a” is not in X’s language if X 
halts with tape #a"# N#. 


The use of special alphabet symbols Y and N—to decide whether a” is in 
the language—follows [18]. For string # #a”# , some X could first halt with 
#a™”# N# and ina second execution could halt with #a”# Y#. The oscillation of 
halting outputs can continue indefinitely, and X’s language is not well defined per 
Definition 8. In this chapter, we avoid ex-machines whose halting outputs do not 
stabilize. 


3.1 Ex-machine 3(x) 


The purpose of Definition 9 is to show that 3(x) can evolve to compute any language 
Lf in £; and that evolutions of 3(x) compute Turing incomputable languages on a 
set of Lebesgue measure | in language space £, where £ also has measure 1. 


Definition 9 (Ex-machine 3(x)) A = {#, 0,1,N, Y, a}. States O ={0,h,n,y, t, v,w, 
x, 8} where halting state h = 1 and states n= 2, y=3,t =4,v=5,w=6,x=7. The 
initial state is always 0. For the reader’s benefit, letters represent states instead of 
explicit numbers. State n indicates NO that the string is not in the language. State y 
indicates YES that the string is in the language. State x helps generate a new random 
bit. 
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({Q|—1,a,x,a,0) 
(JQ) —1,#,x,#,0) 


,#,0, ((Q|—1,#,n,#,1)) 
#,0 —1,#,y,#,1)) 


Q 
Q|—1,#,n,#,1)) 
(t,1,w,a,0, (\Q|—1,#,y,#,1)) 
Q 
Q 


—1,a,|Q|,a,1)) 
—1,a,|Q|,a,1)) 
/|Ql,a,1, ((Q)—1,a,|Q],a,1)) 


With initial state 0 and tape # #aaaa##, an execution instance of 3(x) is below. 


STATE TAPE HEAD INSTRUCTION EXECUTED NEW INSTRUCTION 
8 aaaatt al (0,#,8,#,1) 
x aaaatt} al (8,a,X,a,0) (8,a,X,a,0) 
t laaa## 1 (x,a,t,l,,0) 
w aaaa#t# 1 (t,1,w,a,0, (\Q|—1,#,y,#,1)) (8,#,y,#,1) 
9 a aaat# 2 (w,a,/Q|,a,1, (JQ|—1,a,|/Q|,a,1)) (8,a,9,a,1) 
x #a aaatt 2 (9,a,xX,a,0) (9,a,x,a,0) 
t a laa## 2 (x,a,t;1,,0) 
w a aaat# 2 (t,1,w,a,0, ({Q|—1,#,y,#,1) ) (9,#,y,#,1) 
10 faa aatt# 3 (w,a,|Q|,a,1, (JQ|—1,a,|Q|,a,1)) (9,a,10,a,1) 
x aa aa## 3 (10,a,x,a,0) (10,a,x,a,0) 
t aa Oat# 3 (x,a,t,0;,0) 
w aa aat# 3 (t,0,w,a,0, ({Q|—1,#,n,#,1) ) (10,#,n,#,1) 
11 aaa a#t# 4 (w,a,|Q|,a,1, (JQ|—1,a,|Q|,a,1)) (10,a,11,a,1) 
x aaa a#t# 4 (11,a,x,a,0) (11,a,x,a,0) 
t aaa 1## 4 (x,a,t,l,,0) 
w #faaa att 4 (t,1,w,a,0, (\Q|—1,#,y,#,1) ) (11,#,y,#,1) 
12 aaaa ## 5 (w,a,|Q|,a,1, (JQ|—1,a,|Q|,a,1)) (11,a,12,a,1) 
* aaaa ## 5 (12,#,x,#,0) (12,#,x,#,0) 
x faaaa O# 5 (x, #,x,0;,0) 
v aaaa ## 5 (x,0,v,#,0, ((Q|—1,#,n,#,1) ) (12,#,n,#,1) 
n aaaa# # 6 (v,#,n,#,1, (JQ|—1,a,/Q|,a,1)) (12,a,13,a,1) 
h aaaa#t N. 6 (n,#,h,N,0) 


This instance of 3(x)’s execution replaces (8,#,x,#,0) with (8,#,y,#,1). 
Instruction (w,a,|Q|,a,1, ({Q|-1,a,|Q|,a,1)) replaces (8,a,x,a,0) with new 
instruction (8,a,9,a,1). Also, the simple meta instruction (|Q|-1,a,x,a, 0) 
temporarily added instructions (9,a,x,a,0), (10,a,x,a,0), and (11,a,x,a,0). 
These instructions are replaced by (9,a,10,a,1), (10,a, 11,a,1), and (11,a 
12,a,1), respectively. Instruction (|Q|-1,#,x,#,0) added (12,#,x,#,0) and 
instruction (12,#,n,#,1) replaced (12,#,x, #,0). Instructions (9,#,y,#,1), 
(10,#,n,#,1), (11,#,y,#,1), and (12,a,13,a,1) are added. Five new states 
9,10, 11, 12, and 13 are added to Q. After halting, 9 = {0,h, n, y, t, v, w, x, 8, 9,10, 
11, 12, 13}, and the evolved ex-machine 3(11010.x) has 24 instructions. 

Two different instances of 3(x) can evolve to two different machines and 
compute distinct languages according to Definition 8. After 3(x) has evolved to 
a new machine 3(aoq1 ...@ x) as a result of a prior execution with input tape # 
#al#, then for each i with 0 <i < m, machine 3(agqq .. . dm x) always halts with 
the same output when presented with input tape # #a!#. 3(aga1 ... dm X)’s halting 
output stabilizes on all input strings a’ where 0 < i < m. Example 4 shows this 
stabilization property. 
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Example 4 (Ex-machine 3(1101 x)) 


(0,#,8,#,1) (y,#,h,Y,0) (n, #,h,N, 0) 


) (x,a,t,0) 

,0, ((Q|—1,#,n,#,1) ) 
10, ((Q|—1,#,y,#,1) ) 
(t,0,w,a,0, (IQ|—1,#,n,#,1)) 
(t,1,w,a,0, (\Q|—1,#,y,#,1)) 


n,#,1, ({Q|—1,a,|Q|,a,1)) 
y,#,1, ((Q|—1,a,|Ql,a,1)) 
/1Q],a,1, (IQ|—1,a,|Q|,a,1)) 


(JQ|—1,a,x,a,0) 
({Q|—1,#,x,#,0) 


(8,#,y,#,1) (8,a,9,a,1) 

(9,4#,y,#,1) (9,a,10,a,1) 
(10,#,n,#,1) (10,a,11,a,1) 
(11,#,y,#,1) (11, ,12;a,cL) 
(12 ‘i. n,#,1) (12,a,13,a,1) 


New instructions (8,#,y,#,1), (9,#,y,#,1), and (11,#,y,#,1) help 
3(11010x) compute that the empty strings a and aaa are in its language, 
respectively. Similarly, the new instructions (10,#,n,#,1) and (12,#,n,#,1) 
help 3(11010.x) compute that aa and aaaa are not in its language, respectively. 
The 1’s in 3(11010x)’s name indicate that the empty strings a and aaa are in its 
language. The 0’s indicate that strings aa and aaaa are not in its language. Symbol 
x indicates that 3(11010 x) has not yet determined for n > 5 whether strings a” are 
in 3(11010 x)’s language. 
Starting at state 0, 3(11010.x) computes that the empty string is in its language 


STATE TAPE HEAD INSTRUCTION 
8 HH HHH Ai (0,#,8,#,1) 
y HHH HH 2 (8,#,y,#,1) 
h HHH YH 2 (y,#,h,Y,0) 


STATE TAPE HEAD INSTRUCTION 
8 #H aati 1 (0,#,8,#,1) 
9 ##a att 2 (8,a,9,a,1) 
10 #Haa #H#H 3 (9,a,10,a,1) 
n #Haa#t ## 4 (10,#,n,#,1) 
h #Haat N# 4 (n,#,h,N, 0) 


Similarly, starting at state 0, 3(11010 x) computes that a and aaa are in its language 
and 3(11010x) computes that aaaa is not in its language. For each of these 
executions, no new states are added and no instructions are added or replaced. Thus, 
for all subsequent executions, 3(11010.x) computes that the empty strings a and 
aaa are in its language, and strings aa and aaaa are not. 

Starting at state 0, below is an execution of 3(11010x) on input tape 
# #aaaaaa#t#. 
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STATE TAPE HEAD INSTRUCTION EXECUTED NEW INSTRUCTION 
8 aaaaaa i. (0,#,8,#,1) 
9 a aaaaat# 2 (8,a,9,a,1) 

10 aa aaaa 3 (9,a,10,a,1) 

11 aaa aaa 4 (1.0.4, TL diy) 

12 aaaa aa 5 (11a 12,4a,2) 

13 aaaaa a 6 (12;.a,13);a;L) 
x aaaaa a## 6 (13,a,x,a,0) 
t aaaaa O## 6 (x,a,t,0;,0) 
w aaaaa a#t# 6 (t,0,w,a,0, (JQ)—1,#,n,#,1) ) (13,#,n,#,1) 
14 aaaaaa 7 (w,a,/Q|,a,1, (JQ|—1,a,|Q],a,1)) (13,a,14,a,1) 
x aaaaaa ## 7 (14,#,x,#,0) (14,#,x,#,0) 
x aaaaaa 1# 7 (x, #,*,1,,0) 
w aaaaaa ## 7 (x,1,w,#,0, ({Q|—1,#,y,#,1)) (14,#,y,#,1) 
y aaaaaa# 8 (w,#,y,#,1, (JQ|—1,a,/Q|,a,1)) (14,a,15,a,1) 
h aaaaaa# Y 8 (y,#,h,Y,0) 


3(11010x) evolves to 3(1101001 x). The first random instruction (x,a,t,0) 
measures a 0, so it executes as (x,a,t, 0 r,0). Instruction (13,#,n,#,1) is 
added due to the random 0 bit; in all subsequent executions of 3(1101001 x), string 
a> is not in 3(1101001 x)’s language. The second random instruction (x,#,x, 0) 
measures a | and executes as (x, #,x,1_r,0). Instruction (14,#,y,#,1) is added. 
In all subsequent executions, string a° is in 3(1101001 x)’s language. 

Definition 10 specifies 3 (aoa, ... dm x) and covers 3(11010 x)’s execution. 


Definition 10 (Ex-machine 3(agq ...dmx)) Let m € N. Set Q = {0,h,n, y, t, 
v,w, X, 8,9,10,... m+8,m+9}. For0 <i < m,a; isOor1.In 3(aga, ... dam x)’s 
instructions, symbol bg = y if ap = 1, else bg =n if agp = 0; symbol bo = y if 
a, = 1, else bb = n if a, = O; and so on until the second to the last instruction 
(m+8,#,bnag,#,1), bm4g =y if dm = 1, else bn+g =n if dm = 0. 


(0,#,8,#,1) (y,#,h,Y,0) (n,#,h,N, 0) 


({Q|—1,a,x,a,0) 
(JQ) —1,#,x,#,0) 


(x,0,v,#,0, (IQ|—1,#,n,#,1)) 

(x,1,w,#,0, (IQ|—1,#,y,#,1)) 

(t,0,w,a,0, (\Q|—1,#,n,#,1)) 

(t,1,w,a,0, (\Q|—1,#,y,#,1)) 

(v,#,n,#,1, (IQ|—1,a,|Q|,a,1)) 

(w,#,y,#,1, (IQ|—1,a,|Q|,a,1)) 

(w,a,|Q|,a,1, (JQ) —1,a,|Q|,a,1)) 

(8,#, bg, #,1) (8,a,9,a,1) (9,#,b9,#,1) (9,a,10,a,1) 
(10,#, bio,#,1) (10,a,11,a,1) . . . (Gi +8,#,bi4g,#,1) (i+ 8,a,i 
9,a,1) 


(m+7,#,bm47,#,1) (m+7,a,m+8,a,1) (m+8,#,bm4s3,#,1) (m+8,a,m 
9,a,1) 
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Lemma 1 /f i satisfies 0 <i < m, string a‘ is in 3(aga, ...dmx)’s language if 
aj = 1, and string a' is not in 3(aga, ...dm x)’s language if a; = 0. Ifn > m, it 
has not yet been determined whether a” is in 3(aoqq . . . am X)’s language or not in 
its language. 


Proof When 0 < i < m, the first consequence follows immediately from the 
definition of a’ being in 3(aoa, ...amx)’s language and from Definition 10. In 
instruction (i + 8,#,bi+s3,#,1) , the state value of bj48 is y if a; = 1 and Dj+¢ is 
n if qQ= 0. 

For the indeterminacy of strings a” when n > m, 3(ag... dm x) executes its last 
instruction (m+8,a,m+9,a,1) when scanning the mth a in a”. For each a to the 
right of #a’” on the tape, 3(ao ...@m x) executes random instruction (x,a,t,0). 

If (x,a,t,0) measures 0, then meta instructions (t,0,w,a,0, (JQ\-1,#,n, 
#,1)) and (w,a,|Q],a,1 (|Q|-1,a,|Q],a,1)) execute. Otherwise, (x,a,t,0) 
measures 1, so (t,1,w,a,0, (|Q\-1,#,y,#,1)) and (w,a,|Q|,a,1, (|Q|-1,a, 
|Q|,a, 1)) execute. If the next alphabet symbol to the right is an a, then a new 
standard instruction executes, derived from an instantiation of (|Q|-1,a,x,a,0). 
When the tape head scans the last a in a”, a new standard instruction executes, 
derived from (|Q|-1,#,x,#,0). 

For each a to the right of #a™” on the tape, the execution of random 
instruction (x,a,t,0) determines whether string aintk , such that 1 < 
k < n-—m, is in 3(aga,...a,x)’s language. After the execution of 
(\Q|-1,#,x,#,0), the tape head is scanning a blank symbol, so the random 
instruction (x,#,x,0) is executed. If the random source generates 0, the meta 
instructions (x,0,v,#,0, (|Q|-1,#,n,#,1)) and (v,#,n,#,1, (|Q|-1,a,|Q|, 
a, 1)) execute. Then, instruction (n,#,h,N,0) executes last, which indicates 
that a” is not in 3(aga,...d,x)’s language. If the execution of (x,#,x,0) 
measures 1, the instructions (x,1,w,#,0, (\Q|-1,#,y,#,1)) and (w,#,y,#, 
1, ({Q| -1,a,]Q|,a,1)) execute. Then, instruction (y,#,h,¥,0) executes last, 
which indicates that a” is in 3(aga,...a,x)’s language. During the execution 
of the instructions, for each a on the tape to the right of #a”, 3(aga,...dm x) 
evolves to 3(aod1 ... dy x) according to the instructions, specified by Definition 10, 
where one substitutes n for m. 


3.2 Some Turing Incomputable Properties of 3(x) 


When the measurements in 3(x)’s two random instructions satisfy both axioms, all 
2” finite paths of length n in the infinite binary tree of Fig. 1 are equally likely. The 
1-to-1 correspondence between f : N — {0, 1} and an infinite downward path (red) 
in the binary tree helps show that 3(x) can evolve to compute any language L f in £. 

Consider 3(x) and all 3(ao....dm x) for each m € N and ao... dm in {0, 1}"*!. 


Theorem 1 Each language L¢ in £ can be computed by the evolving sequence of 


ex-machines 3(x), 3(f (0) x), 3(f (0) fC) x), ..., 3(fO) fC)... f(™) x), .... 
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Fig. 1 Infinite binary tree. A graphical representation of {0, 1} 


Proof Apply Definitions 9 and 10 and Lemma 1. 


Corollary 1 For any f : N > {0, 1} and any n, the evolving sequence 3(f (0) x), 
. IfOfA)...f@ fin + 1) x), .... computes language L -. 


Corollary 2 For each n, the evolution of ex-machines 3(x), 3(f(0)x), 
3(f 0) fC) x), ..., 3(fO) fC)... f() x) have cumulatively used only a finite 
amount of tape, finite number of states, finite number of instructions, and finite 
number of instruction executions, and only a finite amount of quantum information 
is measured by the random instructions. 


Proof Remark 3 and Definitions 5 and 10 imply finite computational resources. 


Theorem 2 and Corollary 3 come from the following intuition. A set X is 
countable if there exists a bijection between X and N. £ is uncountable, so most 
languages L in £ are Turing incomputable. Since each Lf is equally likely of 
being computed by 3(x), most languages computed by 3(x)’s evolution are Turing 
incomputable. 

For each n ¢€ N, define language tree £(ag...dn) = {Ly : f € {0, WS and 
f@ =a; for i such that 0 <i < n}. Define subtree G(aj...a,) = 
{f € {0,1)8 : f@) = a such that 0 <i < n}. Let W be this 1-to- 
1 correspondence: £ & {0, 1}§ and L(ag... an) & G(ao...dn). Since random 
axioms | and 2 hold, each finite path f(0) f(1)... f(m) is equally likely. There 
are 2"+! of these paths, so each path has probability 2~”+!), The uniform 
probabilities on finite strings of the same length extend to Lebesgue [9, 22] measure 
jt on probability space {0, 1} . Subtree G(ag...d,) has measure 2-“@+)) | where 
u(G(ao..-4n)) = 2-*) and w({0, YN) = 1. Via W, w induces uniform 
probability measure v on £, where v(L(ao ae -n)) = 2-™+) and v(£) = 1. 


Theorem 2 The Turing incomputable languages L ¢ have measure I in (v, £). 


Proof The Turing computable functions f : N — {0, 1} are countable. Via the U 
correspondence, the Turing computable languages L ¢ have v-measure 0 in £. 


Corollary 3 For all ay... dm in {0, 1}"*!, 3(ag ... am x) is not a Turing machine. 


Proof 3(x) can evolve to compute Turing incomputable languages on a set of 
v-measure 1 in £. 3(ao ...@,_X) can evolve to compute Turing incomputable 
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languages on a set of v-measure 2~ "+ in £. Each Turing machine only computes 
one language, so the measure of all Turing computable languages is 0 in £. 


4 An Ex-machine Halting Problem 


In [23], Turing posed the question, does there exist a Turing machine 9 that can 
determine for any given Turing machine M and finite tape T whether M’s execution 
on tape T eventually halts? Turing proved that no Turing machine could solve this 
problem. His halting problem can be extended to ex-machines. Does there exist 
an ex-machine X(x) such that for any given Turing machine M, then X(x) can 
sometimes compute whether M’s execution on finite initial tape T will eventually 
halt? In order for this question to be well-posed, the phrase can sometimes compute 
whether must be defined. 

From the universal Turing machine / enumeration theorem [21], there is 
a Turing computable enumeration € : N — {Turing machines M} x 
{Each initial state of M} of every Turing machine. Similar to ex- 
machines, for each machine M, the set {Each initial state of M} is 
realized as a finite subset {0,...,1 — 1} of N. Since €(m) is an ordered pair, the 
phrase “Turing machine €(n)” refers to the first coordinate of E(m). The “initial 
state E(n)” refers to the second coordinate of E(m). Turing’s halting problem is 
equivalent to the blank-tape halting problem [19]. The blank-tape halting problem 
translates to: for each Turing machine €(7), does E(n) halt when €(7) begins 
executing with a blank initial tape and initial state E€(n)? 

Lemma | implies that the same initial ex-machine can evolve to two different ex- 
machines; these two ex-machines will never compute the same language no matter 
what descendants they evolve to. For example, 3(0 x) and 3(1 x) can never compute 
the same language in £. Hence, sometimes means that for each n, there exists an 
evolution of X(x) to X(aox), then to X(aga,x), and so on up to X(agaq ...an x) 
..., Where for each i withO <i <n, then X(aga,...a, x) correctly computes 
whether Turing machine €(n) halts or does not halt. The word computes means 
that X(aga, ...a; x) halts after a finite number of instructions executed, and the 
halting output written by X(aoa, ...a; x) on the tape indicates whether machine 
€(n) halts. For example, if the input tape is # #a‘#, then enumeration machine 
Me writes the representation of E(i) on the tape, and then X(agqq ...am x) with 
m > i halts with # Y# written to the right of the representation for machine €(/). 
Alternatively, X(aoa1 ...dmx) with m > i halts with # N# written to the right 
of the representation for machine €(i). The word correctly means that ex-machine 
X(aoa, ...dm xX) halts with # Y# written on the tape if machine E€(7) halts and ex- 
machine X(agq1 ...dm x) halts with # N# written on the tape if machine E(i) does 
not halt. 

Next, the ex-machine halting problem is transformed so that the results from 
Sect.3 can be applied. Choose alphabet 2 = {#, 0, 1, a, A, B, M, N, S, X, Y}. 
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As before, identify the set of Turing machine states as a finite subset of N. Let 
Mg be the Turing machine that computes a Turing computable enumeration * as 
E, : N > {2}* x N, where the tape # #a”# represents natural number n. Each 
€,(n) is an ordered pair where the first coordinate is the Turing machine and the 
second coordinate is an initial state chosen from €,(7)’s states. Define the halting 
function he, : N — {0, 1} such that for each n, set he, (n) = 1, whenever E,(n) 
halts. Otherwise, set he, (n) = 0, if Eg(n) with blank initial tape and initial state 
€,(n) does not halt. Function h¢, (1) is well defined because for each n € N, with 
blank initial tape and initial state €,(n), Turing machine €, (7) either halts or does 
not halt. Via function h¢,(n) and Definition 7, define halting language Li... 


Theorem 3 There exists an evolutionary path for ex-machine 3(x) that computes 
halting language Lhe,? namely, 3(he, (0) x) > 3(he,(0) he,() x) > ... 
3(he, (0) he, (1)... he, (m) x)... 


Proof Apply the mathematical developments in the previous three paragraphs, 
using halting function he,, language Ly, , and Theorem 1. 


Theorem 3 implies that a proof by contradiction for Turing’s halting problem 
does not hold for ex-machines: the existence of path 3(he,(0) x) > 3(he, (0) 
he,() x) > ... 3(he,(0) he,C) ... he,(m) x) ... circumvents the 
contradiction. From an information-theoretic perspective, almost every (w.r.t. to 
on {0, 1}) evolutionary path 3(f(0) x) > 3(f()f(I) x) > ... 3(/f OFC) 
...f(m) x) ... avoids the contradiction in Chaitin’s information-theoretic proof 
[5] that the halting problem for Turing machines is unsolvable. The contradiction 
depends upon the following: the minimum number of bits needed to represent 
a Turing machine stays constant. In contrast, there is a set § C {0, 1} with 
(8) = 1 such that for all f € §, the minimum number of bits needed to represent 
3(f (0) fC)... f() x) increases without bound as n increases. 


5 A Research Direction 


Theorem 3 and information-theoretic analysis both show that a proof by contradic- 
tion of the unsolvability of Turing’s halting problem does not apply to ex-machines. 
This capability suggests that novel self-modification procedures, cleverly integrated 
with randomness, should be explored to help enhance theorem proving [2, 6] and 
constructive type systems that use conservative workarounds [20] to avoid the 
halting problem. 


4Chapter 7 of [19] provides explicit details of encoding quintuples with a particular universal 
Turing machine. Alphabet 21 was selected to be compatible with this encoding. A careful study of 
chapter 7 provides a clear path of how Me’s instructions can be specified to implement €,. 
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Fig. 2 Machine configuration (g, k, T) before executing a standard instruction 


6 Conclusion 


We showed that ex-machines can compute Turing incomputable languages and 
that ex-machines are not limited by the halting problem for Turing machines. The 
language computed by an ex-machine reflects its computational capabilities. The 
problem of determining program correctness for a digital computer program is 
unsolvable by a Turing machine. The detection of an infinite loop in a computer 
program (i.e., a case of program correctness) can be reduced to Turing’s halting 
problem. For these reasons, it is important to understand how far methods of 
evaluating program correctness for digital computer programs can be extended with 
randomness and advanced self-modification procedures. 


Appendix: A Turing Machine Is an Autonomous Dynamical 
System 


Fix a Turing machine M. Transformation @ maps a machine configuration to a point 
in the complex plane C; ¢ also maps each of M’s instructions to a finite number | A| 
of unique affine functions each with a distinct domain. These affine functions can 
be extended to a function F on a bounded region W in C, containing these domains 
and a disjoint bounded set, called the halting attractor. Via ¢, one computational 
step of M corresponds to one iteration of the discrete autonomous dynamical system 
(F, W). 

Let machine states Q = {q1,..., Gm}. Let alphabet A = {a,,...,a,}, where 
a, is the blank symbol. Halt state h is a special state that is not in Q. Function 7 : 
QxA— QU {h} x Ax {—1, +1} is the machine M’s program. A single instruction 
is n(q,a) = (r, b,x), where g € Q,r € QU {h}, a,b € A, and x € {—1, +]}. 
Set B = |A| + |Q| + 1. Define symbol value function v : {nh} JQUA > N as 
v(aj) = 0,..., v(aj) =i—-1,..., vn) = |A| — 1, vA) = Al, v(qi) = JAI + 1, 
...,V(qi) = |A| +i, .-., V(dm) = |Al + |QI. 


Po ies [is [ea [Te] 6 [in | [tes [es] ~ | 


Fig. 3. Machine configuration after executing instruction 7(q, Tx) = (7, b, +1) 
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Fig. 4 Machine configuration after executing instruction 7(q, Ty) = (7, b, —1) 


T : Z — A is the tape and is finite. 7, is the alphabet symbol in tape square 
k. Machine configuration (g,k, T) lies in Q x Z x AZ and maps to the complex 
number: 
[o,@) [o,@) 
(qk, T) = |Alv(Te) +) v (Tee diA! + (Bv@) +) vTi-j-DIAT) i. 
j=0 j=0 
(1) 


In Eq. 1, the infinite series in both the real and imaginary parts sums to rational 
numbers because the initial tape squares contain a finite number of non-blank 
symbols. 

Next, we define how ¢ maps each instruction in program 7 to a finite set of affine 
functions. When instruction n(q, Tx) = (r, b, +1) executes, state g moves to state 
r, symbol b replaces T; on tape square k, and the head moves to tape square k + 1. 

The right affine functions corresponding to instruction n(q, 7%) = (r,b, +1) 
are of the form f(x + yi) = fi(x) + fo) i, where fi(x) = |Alx +m and 
ho) = ay +n. Using Eq. | and Fig.3 to solve for m and n, ¢ maps instruction 
n(q, Tk) = (r, a, +1) to the affine function f(x + yi) = fi(x) + fo(y) i, where 


fax) = [Ale + (Al — Dv (Ten) — [AP oC) (2) 
ia se OO 3) 
ue Tal ap 


For each of the |A| distinct values v(7;+1) in fi, f is a different affine function. 
Thus, there are | A| distinct affine functions that correspond to instruction n(qg, Tk) = 
(r, b, +1). The domain of each right affine function is Uj,~ = {x +yieEC:j< 
x<jtilandk<y<k+ |Al}, where j = |A|v(7x) + v(7p41) and k = Bv(q). 

When 7(q, 7x) = (r, b, —1) executes, state g moves to state r, symbol b replaces 
Ty on square k, and the head moves to tape square k — 1. 

From Eq. | and Fig.4, @ maps instruction n(q, T,) = (7, b, —1) to affine function 
g(x + yi) = gi(x) + g2(y) i, where 


1 
gi(x) = ia + |Alv(Tk-1) + vb) — v(Ty) (4) 


82(y) = |Aly + Bv(r) — |A|Bv@q) — |Alvx-1). (5) 


For each of the |A| distinct values v(7,_-1) in g; and go, g is a different 
affine function. Thus, there are |A| distinct left affine functions that correspond 
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to instruction n(qg, Tk) = (r,b,—1). The domain of each left affine function is 
Vik = {x + yi eC:j<x<jt|Alandk<y<k+ 1}, where j = |A|v(7x) 
and k = Bv(q) + v(Tk-1). 

Define halting attractor H = {x +yi€C:0<x <A? and BJA <y< 
(B+ 1)|Al}. The points in C that correspond to halting configurations (h, k, T) 
are called halting points. Using elementary algebra and simple geometric series 
calculations, one can verify that the halting points are a subset of H. Define halting 
map bh: H — HH, where h(x + yi) = x + yi on H. Every point in the halting 
attractor is a fixed point of h. Moreover, the intersection of each affine function’s 
domain and H is empty. This implies that § and all left and right affine functions 
corresponding to 7’s instructions can be extended to a function F on domain W that 
contains H and all domains U;,, and V;_x. 

Overall, the ¢ correspondence transforms Turing’s halting problem to a discrete 
autonomous dynamical systems problem in C. If machine configuration (g,k, T) 
halts after n computational steps, then the orbit of ¢(q¢,k, 7) exits one of the 
domains U;, or V;,, on the nth iteration and enters the halting attractor H. If 
machine configuration (r, j, 5) never halts, then the orbit of é(r, j, S) never reaches 
the halting attractor. 
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